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PROTECTING SECRET DATA ENTRY FROM 
INFRARED AND AUDIO EAVESDROPPING 

Field of the Invention 

This invention relates to methods and systems for protecting secret data entry 
from infrared and audio eavesdropping. 

Background of the Invention 

In today's emerging information society, more and more personal and 
proprietary information is stored in electronic databases. To prevent unauthorized 
access to these private databases, many electronic systems, computers, and networks 
require users to enter secret data to initialize a security relationship. While efforts 
have been made to utilize biological characteristics as secret data, through methods 
such as voice identification or retinal scanning, widespread use of these methods is 
years, if not decades, away. The predominant method for providing secret data 
remains the use of a data entry device, typically a keyboard or keypad, to enter secret 
data, such as a password or PIN (Personal Identification Number). Entry of the 
proper secret data initializes a security relationship. 

The types of security relationships that are established by means of shared 
secrets include, but are not limited to, authentication, encryption, and digital signing. 
In authentication, the possession of the secret verifies the identity of the possessor. In 
encryption, the secret is used to cryptographically transform a message so it is 
concealed from third parties but may be transformed back into readable form by one 
possessing a related secret. In digital signing, a hash is computed over a block of 
data. The hash is then encrypted with the private cryptographic key of the signer. 
The signature can be tested by decrypting the signature with the public cryptographic 
key of the signer and comparing the result to a just-computed hash of the data block. 
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If these values match, it shows that the signer had the private key corresponding to the 
public key and also that the data block has not changed. 

Authentication credentials are often divided into two parts so that security is 
not compromised even if one part is lost or stolen. For example, a person wishing to 
5 transact business at an Automatic Teller Machine generally identifies himself or 

herself by presenting an "ATM card" and concurrently entering a string of numbers 
called a "PIN" (Personal Identification Number) onto a keypad. The "ATM card" 
bears identifying information, such as an account number, encoded on a magnetic 
stripe. A person possessing only half of the secret, only the ATM card or only the 

10 secret PIN, is not authorized to perform transactions. Similarly, home security 
systems rely on the authorized entrant to possess both a key to the house and a 
security system PIN. An authorized entrant generally disables a home security system 
alarm by using a keypad to enter a secret string of numbers. If a person entering the 
house fails to enter the correct PIN within a short period of time, the alarm system 

1 5 may automatically summon law enforcement personnel to apprehend the unauthorized 
person. 

While many systems divide authentication credentials into a tangible object 
and a password or PIN, many systems rely solely on a password or PIN for 
authentication. For example, new short-range wireless data communications systems, 

20 such as the Bluetooth standard, use a PIN to generate a link key. The link key serves 
for authentication and encryption allowing secure communication between a pair of 
devices. Similarly, passwords are commonly used to secure access to computers and 
networks. For systems that rely entirely on a password or PIN for authentication, the 
security of the entire system may be adversely affected if the password or PIN is lost, 

25 stolen, or otherwise compromised. 

A password or PEN may be stolen in several ways including detecting the 
keypad or keyboard using a physical sensor while the user enters his or her password 
or PIN or tapping into the electrical circuit or network downstream from the keypad 
or keyboard to capture the password or PIN after the user has entered it into the 

30 keypad or keyboard. Previous efforts have been focused on protecting PINs and 

passwords from this latter form of compromise; however, little work has focused on 
detection of secret data entry by physical sensors. 
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One way to steal a password or PIN using a physical sensor is to observe the 
keypad or keyboard as the user enters his or her PIN or password. This observation 
may be performed either visually or by means of an optical device such as a camera. 
Structures designed to prevent this type of monitoring are described in U.S. Patent 
5 5,748,728 to Ginsberg et al. entitled "Shield for Concealing Operation of a Keypad". 
These structures may have provided some protection of passwords and PINS when the 
eavesdropping threat was limited to optical sensors. However, such simple security 
measures are increasingly ineffective as new highly-sophisticated physical sensors 
become readily available. This new breed of physical sensors includes devices that 

10 detect infrared signatures as well as refined audio sensors. 

Devices that create images by detecting the infrared portion of the 
electromagnetic spectrum are well-known. These devices typically have been used in 
the public sector as military and police personnel may often use them to image human 
beings and structures in low-light conditions. Rescue workers use these devices in 

1 5 search-and-rescue operations to locate persons trapped in damaged buildings. 

Firemen use them to locate hot spots in burning buildings. Additionally, infrared- 
imaging devices are used routinely for medical diagnostic purposes to image the 
human body and differentiate between body areas of normal temperature and those 
with abnormal temperature, which might indicate a disease process, injury, or the like. 

20 Some infrared detectors are so sensitive that they can image, for example, footprints 
in the ground, by discerning the slight difference between the average background 
temperature and a temperature that is slightly elevated as a result of human contact. 

An eavesdropper could use a sensitive infrared-imaging device to inspect a 
keyboard or keypad shortly after a person has entered a secret such as a PIN thereon. 

25 The eavesdropper would prefer to perform the imaging after the person entering the 
PIN has left the area in order to remain undetected by the person entering the PIN. 
The infrared-imaging device would be used to create an image of the heat signature 
on the keypad. The heat signature on the keys most recently touched would be 
slightly more intense than those touched earlier in the PIN sequence. By comparing 

30 the temperature values for the keys and arranging them in sequence from the coolest 
to the warmest, the eavesdropper could form a strong hypothesis about the sequence 
in which the keys were touched. 
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For example, Figure 1 shows a conventional data entry device as detected 
using an infrared-imaging device. In this figure, the data entry device 10 is a keypad 
with keys 11 on it. This image of the keypad is taken immediately after a user has 
entered his or her PIN. In the image, the background temperature is represented by 
5 white. Temperatures above the background temperature are represented by varying 
shades of gray with black being the hottest temperature. As shown in Figure 1, the 6 
key is the darkest shade of gray. The 5 key is a slightly lighter shade of gray. The 2 
key is lighter still. Finally, the 1 key is the lightest shade of gray. Thus, the 1 key is 
the coolest and the 6 key is the warmest. Now arranging the keys in order from 

10 coolest to warmest, the eavesdropper learns that the user's PIN is 1-2-5-6. Depending 
on the accuracy of the temperature data, infrared imaging may immediately and 
unequivocally reveal the PIN. Even if the shades of gray are very close together, this 
imaging greatly reduces the number of combinations that must be tried to learn the 
secret PIN. For example, if the shades of gray in Figure 1 had been indiscernible, the 

1 5 use of imaging would still have reduced the number of combinations that the 
eavesdropper must try from 10,000 to 24. 

One way of thwarting infrared detection is to require that PIN numbers include 
one or more repeated digits. Keys that are touched more than once are likely to be 
warmer than would otherwise be the case. For example, if a PIN number were 1223, 

20 the heat signature would likely show that the 2 key is the warmest since it was 

touched twice, followed by the 3 key, with the 1 key being the coolest. Thus, an 
eavesdropper would incorrectly surmise that the PIN was 23 1 . However, if the 
eavesdropper realized that the PIN contained four digits, knowing in advance that all 
PIN numbers have one or more repeated digits would merely reduce the number of 

25 combinations that must be tried. As a result, this method of thwarting infrared 
detection would actually reduce the PIN's effectiveness as a secret. Therefore, a 
strong need exists for a way of thwarting infrared detection of secret data entered into 
data entry devices without reducing the data's effectiveness as a secret. 

Aside from infrared-imaging devices, eavesdroppers could use refined audio 

30 sensors to discover secret data, such as a PIN or password, without resorting to direct 
observation. To discover a PIN, an eavesdropper might place a hidden microphone 
attached to a recording device in position to detect sound generated by entering data 
into a data entry device. The eavesdropper could then subject the recorded sound to a 
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sensitive analysis, such as a Fourier transform, of the audio spectrum associated with 
pressing each key on a keyboard or keypad. This analysis may yield a distinctive, 
repeatable audio signature for each key. Such analysis is now increasingly possible 
with the computing-power of ordinary, inexpensive personal computers. Each key 
5 may have a different audio signature based on its physical characteristics and it 
physical location. The physical characteristics of each key will be different for a 
number of reasons. Different physical characteristics occur as part of the 
manufacturing process. Each key is manufactured within relatively imprecise 
tolerances such that there is an extremely small likelihood that two keys on the same 

1 0 keypad are exactly alike. Additionally, over time the striking surfaces of the keys on 
a keypad experience varying degrees of wear. This non-uniform wear contributes to 
distinct audio signatures for each key on the keypad. The physical location of each 
key on the keypad also contributes to distinct audio signatures for each key. Since 
each key is physically located in a different place on the keypad, any echoes from 

1 5 nearby objects, such as a shield around the keypad of an ATM machine, may be 
different for each key pressed. This difference occurs as a result of sound waves 
bouncing off nearby reflectors at different angles and travelling different distances 
prior to reaching the microphone. This audio spectrum information, either alone or in 
combination with the aforementioned infrared imaging means, may yield a very high 

20 probability of uncovering a secret PIN without direct visual or optical observation of 
entry. 

Summary of the Invention 

It is therefore an object of the present invention to provide methods and 
25 systems for protecting secret data entry from infrared eavesdropping. 

It is another object of the present invention to provide methods and systems 
for protecting secret data entry from audio eavesdropping. 

These and other objects are provided, according to the present invention, by a 
method for protecting a data entry device from eavesdropping that includes masking a 
30 signature of entry resulting from entry of data by a user of the data entry device so as 
to reduce the detectability of the signature by eavesdropping. 

According to the present invention, the signature may include a temperature 
differential in the data entry device from data entry by the user and the masking may 
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include controlling the external temperature of the data entry device to reduce 
temperature differentials left in the data entry device by the user. 

In a preferred embodiment, controlling the external temperature of the data 
entry device includes maintaining the external temperature in a range surrounding a 
5 predetermined setpoint. The predetermined setpoint may be between about 35-40°C. 
By controlling heating and cooling, the temperature differentials in a data entry device 
that a user creates by entering data into the device may be reduced such that these 
temperature differentials are less detectable by an infrared-imaging device. 

According to the present invention, the signature may also include sound 
1 0 waves emitted from the data entry device and the masking may also include masking 
sound waves emitted from the data entry device to reduce the detectability of the 
sound waves. 

In a preferred embodiment, the masking of sound waves includes generating 
an interfering sound pattern so as to reduce the detectability of the sound waves. 
1 5 Generating the interfering sound pattern includes receiving the signature, converting 
the signature to an electrical signal, phase-shifting the electrical signal, converting the 
phase-shifted electrical signal to an audio signal, and emitting the audio signal in 
close proximity to the data entry device. By providing an interfering sound pattern, 
the sound waves created by data entry into a data entry device may be masked to 
20 reduce the detectability of the sound waves by audio eavesdropping. 

According to the present invention, a system may also be employed for 
protecting data entry to a data entry device from eavesdropping. The system includes 
a data entry device and a means for masking a signature of entry resulting from entry 
of data by a user of the data entry device so as to reduce the detectability of the 
25 signature by eavesdropping. 

In a preferred embodiment, the means for masking includes a means for 
establishing the external temperature of the data entry device to reduce temperature 
differentials left in the data entry device by the user. 

In another preferred embodiment, the means for masking includes a means for 
30 masking sound waves emitted from the data entry device to reduce the detectability of 
the sound waves. 

Methods and systems according to the present invention may therefore protect 
secret data entry into a data entry device by a user from infrared and audio 
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eavesdropping. It will be understood that the present invention may be embodied as 
methods and systems and combinations thereof. 

Brief Description of the Drawings 

5 Figure 1 illustrates a conventional data entry device immediately after use by a 

user. 

Figure 2 illustrates a conventional data entry device immediately after use by a 
user after employing the present invention. 

Figure 3 illustrates a temperature feedback control circuit according to the 
10 present invention. 

Figure 4 illustrates a system for providing resistive heat to a data entry device 
according to the present invention. 

Figure 5 illustrates a system for providing convective heat in proximity to a 
data entry device according to the present invention. 
15 Figure 6 illustrates a system for radiating heat in proximity to a data entry 

device according to the present invention. 

Figure 7 illustrates a noise cancellation circuit according to the present 
invention. 

Figure 8 illustrates a system for providing an interfering sound pattern using a 
20 sound generator according to the present invention. 

Detailed Description of Preferred Embodiments 

The present invention now will be described more fully hereinafter with 
reference to the accompanying drawings, in which preferred embodiments of the 

25 invention are shown. This invention may, however, be embodied in many different 
forms and should not be construed as limited to the embodiments set forth herein; 
rather, these embodiments are provided so that this disclosure will be thorough and 
complete, and will fully convey the scope of the invention to those skilled in the art. 
Like numbers refer to like elements throughout. 

30 Figure 2 shows a data entry device 10 that utilizes keys 11 for data entry. In 

Figure 2, the assumption has been made that background temperature is less than the 
temperature of the user. The keys 11 have been heated above background 
temperature so as to mask any temperature differential that might be created in the 
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keys 11 when a user utilizes them to enter data into the data entry device 10. This 
masking reduces the infrared detectability of the data entered into the data entry 
device 10. Of course if the background temperature were hotter than the temperature 
of the user, the keys 1 1 could be cooled to mask any temperature differential that 
5 might be created in the keys 11 when the user enters data into the data entry device 
10. Various systems for masking temperature differentials in data entry devices to 
reduce infrared detectability are described in Figures 3-6. 

Referring now to Figure 3, a feedback control circuit of the present invention 
will now be described. A temperature sensor 30 is operably associated with a data 
10 entry device 10. The temperature sensor 30 measures the temperature of the external 
surface of the data entry device 10. The temperature sensor 30 is also operably 
associated with a control circuit 31, which is operably associated with a 

IseP.. 

*I3; heating/cooling device 32. The data entry device 10 may be a keypad, a keyboard, a 

,g touch-tone phone, or any other known data entry device. The temperature sensor 30 

15 may conveniently be a thermocouple or any other known temperature-sensing device. 

N! The heating/cooling device 32 may be a resistive heating element, an infrared 

hi- 

g "~ emitting lamp, a blower, or any other known means for providing cooling or heating 

y to a data entry device. 

M Still referring to Figure 3, the temperature sensor 30 provides the control 

s : !s 

20 circuit 31 with the external temperature of the data entry device 10. The control 
*l3 circuit 31 compares the external temperature of the data entry device 10 as measured 

by the temperature sensor 30 with a predetermined setpoint. If the external 
temperature of the data entry device 10 as measured by the temperature sensor 30 is 
higher than the predetermined setpoint, the control circuit 31 sends a signal to the 

25 heating/cooling device 32 directing it to cool the data entry device 10. This cooling 
continues until the external temperature of the data entry device 10 as measured by 
the temperature sensor 30 equals the predetermined setpoint. At that time, the control 
circuit 31 sends a signal to the heating/cooling device 32 directing it to stop cooling 
the data entry device 10. Similarly, if the external temperature of the data entry 

30 device 10 as measured by the temperature sensor 30 is lower than the predetermined 
setpoint, the control circuit 31 sends a signal to the heating/cooling device 32 
directing it to heat the data entry device 10. This heating continues until the external 
temperature of the data entry device 10 as measured by the temperature sensor 30 



8 




equals the predetermined setpoint. At that time, the control circuit 31 sends a signal 
to the heating/cooling device 32 directing it to stop heating the data entry device 10. 
Suitable control circuits for carrying out temperature feedback control are known to 
those of skill in the art and need not be described further herein. 
5 While Figure 3 illustrates a feedback control system, as will be appreciated by 

those of skill in the art, an open loop system may also be utilized. Thus, for example, 
a heating source may be continuously operated. Also, while the present invention is 
described in Figure 3 as both heating and cooling, as will be appreciated by those of 
skill in the art, only one of heating or cooling may be needed. Thus, the present 

10 invention should not be construed as limited to both heating and cooling. 

Referring now to Figure 4, a system for resistively heating a data entry device 
10 of the present invention so as to reduce temperature differentials left in the data 
entry device by the user will now be described. Keys 11 reside on a data entry device 
10. A resistive heating element 40 also resides on the data entry device 10 such that 

15 the resistive heating element 40 provides heat to the keys 11 when an electrical 

current is applied to the resistive heating element. The resistive heating element 40 
may conveniently be a resistive pattern of wires surrounding the keys 11. The 
resistive heating element 40 could also be a resistive layer formed as part of a data 
entry device 10, which is formed using methods such as those described in U.S. 

20 Patent No. 5,828,016 to Grannan et al. entitled "Low Profile Tactile Switch the 
disclosure of which is incorporated herein by reference. The keys 11 could be 
constructed from a thermally conductive material such as aluminum, copper, nickel, 
or any other thermally conductive material. Alternatively, the keys 11 could be plated 
with a thermally conductive material such as aluminum, copper, nickel, or any other 

25 thermally conductive material. 

Referring now to Figure 5, a system for heating or cooling a data entry device 
10 by convection will now be described. A blower 50 directs a stream of air 51 in 
close proximity to a data entry device 10. The stream of air 51 may be temperature- 
controlled such that it is hotter or cooler than the data entry device 10. The stream of 

30 air 51 may blow directly on the data entry device 10, thus heating or cooling the 

surface of the data entry device 10. Heating the device using the stream of air may 
reduce the temperature differentials in the data entry device created when a user 
enters data into the device. Alternatively, or concurrently, the stream of air 51 could 
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be directed so as to form a thermal curtain in front of the data entry device 10. The 
thermal curtain could mask temperature differentials created when a user enters data 
into the data entry device 10 by forming a thermal barrier in front of the data entry 
device 10. If an eavesdropper attempted to image the data entry device 10 with an 
5 infrared-imaging device, the thermal barrier would create an image on the device that 
masks the image of the data entry device 10. As viewed using the infrared-imaging 
device, the thermal barrier may appear to be a substantially opaque curtain draped in 
front of the data entry device 10. 

Referring now to Figure 6, a system for heating a data entry device 10 by 
10 radiation will now be described. An infrared emitting lamp 60 is operably associated 
with a data entry device 10. The infrared emitting lamp 60 radiates heat 61 in 
proximity to the data entry device 10. The infrared emitting lamp 60 may radiate 
b|3 directly onto the data entry device 10, thus heating the surface of the data entry device 

% 10. Alternatively, or concurrently, the infrared emitting lamp 60 may radiate in front 

& 15 of the data entry device 10 forming a thermal curtain in front of the data entry device 

s j 10. As with the stream of air, the thermal curtain could mask temperature 

5s?sf differentials created when a user enters data into the data entry device 10 by forming a 

O thermal barrier in front of the data entry device 10. If an eavesdropper attempted to 

-*S3, 

$2 image the data entry device 10 with an infrared-imaging device, the thermal barrier 

20 would create an image on the device that masks the image of the data entry device 10. 
=|1 As viewed using the infrared-imaging device, the thermal barrier may appear to be a 

substantially opaque curtain draped in front of the data entry device 10. 

The foregoing Figures and descriptions have shown how the present invention 
can be used to reduce temperature differentials left in a data entry device when a user 
25 enters data into the device. However, the present invention is not limited to protecting 
data entry to a data entry device from thermal eavesdropping. The present invention 
also is directed to protecting data entry to a data entry device from audio 
eavesdropping. Various systems for masking sound waves created by data entry into 
data entry devices to reduce audio detectability are described in Figures 7-8. 
30 Referring now to Figure 7, a system for canceling the sound waves produced 

by entering data into a data entry device 10 will be described. A sensitive microphone 
70 is operably associated with a data entry device 10. The sensitive microphone 70 
receives sound waves produced by the entering of data into a data entry device 10 by 
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a user. The sensitive microphone 71, which is also operably associated with a noise 
cancellation circuit 71, converts the sound waves to an electrical signal and sends the 
electrical signal to the noise cancellation circuit 71. After receiving the electrical 
signal, the noise cancellation circuit 71 shifts the phase of the electrical signal, 
5 preferably by 180°. The phase-shift may be accomplished in real time using an 

adaptive digital signal processor such as those known to those skilled in the art. The 
processor delays components of the audio spectrum by one-half wavelength so that 
they are out of phase with the audio inputs. Then, the noise cancellation circuit 71 
sends the phase-shifted electrical signal to a speaker 72. The speaker 72 is located in 
10 close proximity to the data entry device 10. The speaker 72 converts the phase- 
shifted electrical signal to an audio signal. The speaker then emits sound waves 73 
corresponding to the audio signal. The emitted sound waves 73 may be substantially 
180° out of phase with the sound waves produced by the entry of data into the data 
entry device 10 by a user. Thus, the emitted sound waves 73 may substantially cancel 

'sr. 

^ 1 5 the produced sound waves such that the operation of the keys on the data entry device 

j may be undetectable by a listening device or have insufficient level to be 

!rf differentiated from each other or background noise. 

3 Referring now to Figure 8, a system for providing an interfering sound pattern 

using a sound generator will be described. A sound generator 80 is operably 
20 associated with a speaker 81, which is operably associated with a data entry device 
10. In a preferred embodiment, the sound generator 80 generates an electrical signal 
corresponding to pre-recorded sounds. The pre-recorded sounds are recorded sounds 
of random input to the data entry device 10. The sound generator 80 sends the 
electrical signal to the speaker 81. The speaker 81 converts the electrical signal to an 
25 audio signal and emits sound waves 82 corresponding to the audio signal in proximity 
to the data entry device 10. By generating an interfering sound pattern, the operation 
of the keys on the data entry device may be undetectable by a listening device or have 
insufficient level to be differentiated from each other or background noise. 

In the drawings and specification, there have been disclosed typical preferred 
30 embodiments of the invention and, although specific terms are employed, they are 
used in a generic and descriptive sense only and not for purposes of limitation, the 
scope of the invention being set forth in the following claims. 



11 



